Immersive VR Visualizations by VFIVE. Part 2: Applications 
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VFIVE is a scientific visualization application for CAVE-type immersive virtual reality systems. 
The source codes are freely available. VFIVE is used as a research tool in various VR systems. It 
also lays the groundwork for developments of new visualization software for CAVEs. In this paper, 
. we pick up five CAVE systems in four different institutions in Japan. Applications of VFIVE in 

each CAVE system are summarized. Special emphases will be placed on scientific and technical 
achievements made possible by VFIVE. 



I. INTRODUCTION 
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. VFIVE is a scientific visualization application for CAVE-type immersive virtual reality (VR) systems. Visualization 
methods and user-interface implemented in this application are described in detail in our complemented paper [l|. 
We started developing visualization software for a CAVE in late 1990s, to visualize data of our own simulations^. 
■ The applications gradually attracted interests of other simulation researchers, and getting their feedbacks, we devel- 
t-H I oped a general-purpose visualization application VFIVE 0,0]. 

We have been improving VFIVE for more than a decade. It is brought up to be a practical tool for three-dimensional, 
interactive visualization in CAVEs through the continued improvements. 

VFIVE is coded with C++ language with OpenGL and CAVElib. Its source codes are freely distributed. The 
purpose of this paper is to summarize its applications and, especially, achievements made possible by VFIVE, in 
several CAVE systems in Japan. 



II. 7T-CAVE AT KOBE UNIV. 



A. Hardware 



7T-CAVE is a CAVE system installed in 2011 at Integrated Research Center (IRC), Kobe University. It is named 
after IRC's location, Port Island (PI). An overview of the 7T-CAVE system is shown in Fig. [TJ 

7T-CAVE has a rectangular parallelepiped configuration with side lengths of 3m x 3m x 7.8m. To the authors' 
knowledge, this is the largest CAVE system in Japan. Its wide width (7.8m) is one of the characteristic features of 
this CAVE system. It enables several people to stand on the floor at the same time, without causing mutual occlusion 
of the screen views in the room. 

7T-CAVE has four screens; three wall screens (front, right, and left) and a floor. Semi-transparent soft screens are 
used for the walls. The images on them are rear-projected. Six sets of Digital Light Processing (DLP) projectors are 
used; see Fig. [2^. The floor is a hard screen on which stereo image is projected from the ceiling. Two projectors are 
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FIG. 1: Overview of 7T-CAVE at Kobe Univ. A rectangular parallelepiped CAVE system with side lengths 3m x 3m x 7.8m. 




FIG. 2: Overview of 7T-CAVE at Kobe Univ. A box-shaped CAVE system with side lengths 3m x 3m x 7.8m. 



used to generate front wall images. The edge blending technique is applied on the interface between the projections. 
Another pair of projectors is used for the floor screen. The resolution of the DLP projector (Christie WU12K-M) is 
1920 x 1200 pixels. The brightness is 10,500 lumens. 

An optical motion tracking system (Vicon) is used for the head and the wand tracking (Fig. [2Jd to e). Ten cameras 
with 640 x 480 resolution are installed on the top of the wall screens. A commonly used commercial API (Trackd) is 
used for the interface. 

Two computer systems are used for the computation and the rendering. One is a Linux-PC (HP Z800) with 192GB 
shared memory. Three sets of external GPU (NVIDIA QuadroPLEX) are used for the real time and stereoscopic 
image generation for the six projectors. Another computer system is a Windows-PC cluster system. VFIVE runs on 
both computer systems. 



B. VFIVE Applications 

One of the most actively applied fields of VFIVE in 7T-CAVE is visualization of MHD (magnetohydrodynamics) 
simulations. Since an MHD simulation produces multiple vector fields such as magnetic field and flow field, grasping 
their mutual interaction is a demanding task for usual visualizations on PC monitors. VFIVE's visualization methods 
for vector fields play important roles in their analysis. 

New visualization components are also developed at 7T-CAVE, on the groundwork of VFIVE. An example that has 
recently been incorporated into VFIVE is "Tube Advector" . 

Magnetic field lines in an MHD fluid such as liquid iron of the Earth's outer core or hydrogen plasma in the solar 
convection zone can be regarded as if they are "frozen" into the fluid flow when the electrical resistivity is negligibly 
small 5]. This frozen- in nature of magnetic field lines in MHD systems plays an important role in the magnetic field 
generation process in celestial bodies. 

A magnetic field generation can be regarded as an increase process of field line density going through a unit area. 
However, no magnetic field line comes from nothing, because the magnetic field is a divergence-free vector field: A 
magnetic field line never has an open end. To increase the number density of magnetic field lines, a field line has to 
be stretched, twisted, and folded. 

To visualize the stretch-twist-fold process of frozen-in magnetic field lines, a new VFIVE visualization method, 
"Tube Advector", was developed^. Sequential snapshots of a VFIVE visualization of geodynamo simulation data 
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FIG. 3: A new visualization component implemented in VFIVE at 7T-CAVE system. This method shows the stretch-twist-fold 
process of a magnetic field lines in a magnetohydrodynamic fluid simulation. 



using this "Tube Advector" are shown in Fig. |3l In this figure, the user specifies an S-shaped curve of a magnetic field 
line with a short beam emitted from the portable controller wand (Fig. [3^ and b). Reflecting the frozen- in nature, 
this field line is conveyed, or advected, by the flow (c) . The user can analyze the thee-dimensional advection motion, 
observing its stretch- twist- fold process in detail (d). 

Recently in Kobe University, a middleware called Multiverse for CAVE systems was developed 0, Q- Multiverse is 
a kind of application launcher or a "3-D Desktop" in the VR space. Multiple CAVE applications can be loaded into 
Multiverse and 3-D icons with virtual touch screens depict them. By touching one of the icons floating in the air 
with the wand, the corresponding application is launched. VFIVE is loaded into Multiverse in 7T-CAVE. The VFIVE 
application shown in Fig. [2] is actually launched from the Multiverse environment. 

III. PCAVE AT KOBE UNIV. 
A. Hardware 

pCAVE, which is shown in Fig. [4j is a one-screen VR system at Kobe Univ. with a rear stereo projector. The 
screen size is W3260mm x H2500mm. A DLP projector (Christie Mirage S+4K) is used. The computer system is 
SGI Asterism Deskside ADT08C with Quadcore AMD Opteron 2350 and 4GB memory. NVIDIA Quadro FX4600 is 
used for the GPU. 




FIG. 4: pCAVE system at Kobe University. One screen VR system with the head and hand tracking system. 



The head and hand tracking system used in pCAVE is Intersense IS-900, which is an inertial and ultrasonic hybrid 
system. CAVELib (ver. 3.2) and VR JugglerQ are used as basic APIs for applications on pCAVE. The current version 
of VFIVE on pCAVE uses only CAVElib. 
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B. VFIVE Applications 

pCAVE system is mainly used as a workbench for CAVE application developers at Kobe University, before porting 
to 7T-CAVE system described in section [TTJ Development of a new visualization method, that is to be incorporated 
into VFIVE in future, is first developed and tested at pCAVE. 




FIG. 5: A new visualization method of VFIVE under development at pCAVE system. This is a visualization method for vector 
fields. Multiple field lines are traced from a short virtual beam emitted from the wand. 



An example of new VFIVE visualization that is under development at pCAVE is "Interactive Field Lines" , shown 
in Fig. [5] In "Particle Tracer" method or "Field Line" method implemented in the original VFIVE, the seed points 
of the line tracings are fixed in space after the user's specification by the wand button pressing. In contrast to them, 
the seed points of the "Interactive Field Lines" move in real time, following the user's hand (or wand) motion. After 
selecting this visualization method from VFIVE's menu, a short beam appears from the wand's tip. Several seed 
points are located on the beam. As the user moves the wand, field line integration with a 4-th order Runge-Kutta 
method of selected vector field is performed in real time. The user can intuitively grasp (possibly) complicated three- 
dimensional structure of the vector field, by moving his/her hand and observing not only the instantaneous shape of 
the field lines, but also their transformation process. Each field line in this "Interactive Field Lines" is colored with a 
stripe pattern. The pattern moves along the line and its drift direction and speed convey information of the direction 
and the amplitude of the vector field. 

IV. HOLOSTAGE-MINI AT UNIV. HYOGO 
A. Hardware 

A CAVE system called Holostage-MINI, which is a commercial brand for a small-sized CAVE system, is installed at 
Univ. Hyogo; Fig. [6] It has two screens; a wall and a floor, with the size of 3.2m x 2.0m for both of them. Two DLP 
projectors (Christie Mirage WU3), 3000 ANSI lumens, are used. The images of the wall screen are projected from 
the rear. Those of floor screen are from the ceiling. The image resolution is 1920x1200 pixels. An optical wireless 
tracking system (Vicon) for the head and the hand is adopted. Four cameras are installed on the ceiling. Active 
shutter liquid crystal shutter glasses are used for the parallax stereo view. 

A Linux-based computer (SGI Asterism ID412) is used for computations and graphics, with 96 GB memory and 
two sets of NVIDIA Quadro FX 5800 are used as GPU. 

CAVElib (ver. 3.2) is used for the basic API in all applications. For the tracking system, Trackd is used. 

B. Applications of VFIVE 

At Univ. Hyogo, an important application, or its descendant, of VFIVE is under development. It is called Mobile- 
VFIVE. 

The purpose of Mobile- VFIVE is to make a common visualization environment between CAVE and PC. Since 
Mobile- VFIVE is coded in JAVA with JOGL (Java Binding for OpenGL), in contrast that original VFIVE is coded 
m it runs on Mac, Linux, and Windows operating systems. 

A problem for power users of VFIVE was that they could make same visualizations on their PC. Even if a user 
has found an intriguing phenomenon in his/her simulation data in the CAVE by applying a couple of visualization 
methods of VFIVE, he/she cannot examine it in detail later on his/her PC. 
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FIG. 6: A two-screens CAVE system installed at Univ. Hyogo. The size of the both screens is 3.2m x 2.0m. 




FIG. 7: A snapshot of Mobile- VFIVE. Mobile- VFIVE is a multi-platform visualization application derived from VFIVE for 
Mac, Linux, and Windows-PCs. 



The purpose of Mobile- VFIVE is to emulate VFIVE in PC. Converting the source codes into JAVA, most visu- 
alization methods in VFIVE are implemented. The input data format is the same as VFIVE. By adding a slight 
modification, one can save visualization states, such as applied visualization methods and their parameters, in the 
VFIVE at Univ. Hyogo. Mobile- VFIVE realizes the visualization by reading the state file. 

Due to the hardware difference, the user interface (UI) of Mobile- VFIVE on PC is very different from that of 
VFIVE in CAVE. The UI of Mobile- VFIVE is developed on the Swing. When the user has found an interesting 
visualization in Mobile- VFIVE, he/she can save the sate into a file. The modified VFIVE can read the file and show 
the visualization in the immersive environment of CAVE. 



V. HOLOSTAGE AT CHUO UNIV. 
A. Hardware 

Holostage is a commercial brand name for rectangular-box-type CAVE systems. A Holostage is installed at Chuo 
University. It is a three-screens system with two walls and a floor; see FigEl The size of the screens are W2.8m x 
D2.1m x H2.1m. 

An optical tracking system (Vicon) is used for the head and hand tracking. Computer system is a Windows-based 
PC cluster. CAVElib and Trackd are used as the basic APIs. 



B. Applications of VFIVE 

One of the most serious limitations of the original VFIVE is the input data format. An important improvement of 
VFIVE is applied at Chuo Univ. to resolve this limitation. 



FIG. 8: A snapshot of Holostage at Chuo University. 




The original VFIVE accepts only structured data, defined on the so-called rectilinear coordinates x-y-z, in which 
grid spacing in each direction of x, y, and z can be non-uniform. There was a version of VFIVE that accepted general 
structured data on curved coordinates, such as the spherical polar coordinates |4|. The version is not maintained more. 

Kashiyama et al. have developed a new visualization application that accepts unstructured cell data fUCD)(loj]. 
All the basic visualization methods such as "Particle Tracers" , "Field Lines" , "Local Arrows" in the original VFIVE 
were rewritten for the UCD data. A snapshot of this application is shown in Fig. |H1 

Technical challenges in the development reside in the interpolation. Spatial interpolations are frequently called in 
many visualization methods in VFIVE. Field data 4>(x,y,z) at a position (x,y,z), that is specified by the wand, for 
example, has to be interpolated from 4>{xt, yi, zi) values where {xi, yi, Zi), with i = 1, . . . , N, are TV nearest grid points. 

To realize the real time response with the head tracking in CAVE, high-speed interpolations are indispensable. 
The interpolation itself is just a linear sum <p(x,y,z) = Wi4>(xi,yi, z{) with weights Wi and it does not cost so 
much. Delaying factor is in the search of the nearest neighbors (xi,yi, Zi). In the rectilinear coordinates, the search is 
completed in three searches of O(N); in x, y, and z directions. On the contrary, the implementation of fast algorithm 
of the grid search in unstructured cells is technically challenging. Kashiyama et al. have resolved this problem 10]. 
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VI. BRAVE AT EARTH SIMULATOR CENTER 
A. Hardware 

BRAVE is a CAVE system installed at Earth Simulator Center. The configuration is a cubic, as the original 
CAVE system, surrounded by four screens (three wall screens and a floor screen). The side length is 3.0m. The DLP 
projectors (Christie Digital Systems, MirageS+3K), 3000 ANSI lumens, are located behind the wall screens. Another 
projector is placed on the ceiling for the floor. The image resolution is 1050x1050 in each screen. 14 sets of infrared 
emitters are placed around the CAVE room for the image synchronization. An optical tracking system (Vicon MX) 
is used for the head and the hand tracking. Four cameras are installed on the ceiling. 




FIG. 10: BRAVE system installed at Earth Simulator Center. 



A Linux-based computer (SGI Asterism Ultra A0532) with 256 GB memory and two sets of NVIDIA Quadro 
PLEX 1000 Model IV is used. Two Quadro FX 5600 are installed in each Quadro PLEX. 

CAVElib (ver. 3.2) is used for the basic API in all applications used in the BRAVE, including VFIVE. For the 
tracking system, Trackd is used. 

B. Applications of VFIVE 

BRAVE system is used mainly for geoscientific data produced by large-scale computer simulation, such as typhoon, 
geodynamo, mantle convection, magnctosphere simulations. 

A lot of visualization methods and functions implemented in VFIVE were developed at BRAVE such as the volume 
rendering, animation, VTK incorporation, and Region of Interest (ROI). See our paperQ for details. 

1. Geodynamo 

One of the most actively applied visualizations of VFIVE in the BRAVE is for geodynamo simulations. The 
purpose of this simulation is to understand the generation mechanism of the geomagnetic field. Large-scale geodynamo 
simulations [Til ll2T| are performed on Earth Simulator Supercomputer. Since the spatial resolution of this calculation 
is the highest in this kind of simulations, the produced data size is enormous. For the geodynamo simulation, the 
data loaded to VFIVE usually amounts to 17 GB in total (17 sets of 1 GB data). 

The visualization of output data of geodynamo simulations is much more difficult compared with a simple CFD 
data with the same size. Three-dimensional variables that should be visualized in the geodynamo simulation are four 
vector fields (flow field, vorticity field, magnetic field, and electrical current field) and, at least, two fields (temperature 
and pressure). 

Through interactive visualizations with VFIVE, a new structure of the electric field was found. When the "Field 
Line" method of VFIVE was applied to fields, they found that the magnetic field lines tend to be straight lines (this 
was expected), and electric current field lines tend to have coil- like structure (this was also expected). However, they 
were surprised that some of the electric current coils exhibit a torus-shape in which a line covers a closed surface of 
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a torus. The pink curves in Fig. [TT] are magnetic field lines, and the blue curves are electric current lines. The blue 
object in near the center of the picture is the closed-torus of the electric current line found in CAVE. This would 
probably be the most important discovery by VFIVEjTTl]. 



2. User Interface using Mobile Devices 
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FIG. 12: A mobile interface applied in VFIVE visualization. Visualization methods as well as parameters are automatically 
recorded through a VFIVE visualization session, (a) The recorded data are shown on the device display, (b) The user specifies 
a visualization method in the list, then their internal parameters, (c) In this case, an isosurface level of a scalar field (cloud 
water density) was selected in the previous step (b) and the isosurface visualization method is re-applied with the that level 
and shown, (d) In this snapshot, stream lines with a vortical structure (a typhoon) was selectively displayed by re-applying a 
proper sets of visualization parameters, that are the releasing positions of the stream lines. 



Recently, researchers at Earth Simulator Center[l3| have developed a new user interface for CAVE systems. The 
purpose of this interface is to control VFIVE with mobile devices such as iPad, iPhone, and Android devices. See 
Fig.rU 

In this version of VFIVE, a user brings a mobile device while the VFIVE application is running in CAVE. A newly 
developed web application runs on the device. A list of visualization methods is shown on the device display. It 
tells visualization methods that have been used in the VFIVE session so far. The user can select one of the methods 
though the usual touch-display interface of the mobile device. The display then shows a detailed list of visualization 
parameters with radio buttons and check boxes. They are parameters that have been applied in the session. 
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When buttons or boxes are selected, the information is sent to the running VFIVE through the wireless network. 
VFIVE re-apply the selected visualization operations with specified parameters. 

It is common in VFIVE visualization that its user applies a lot of visualization methods with many different 
visualization parameters in each method. In this improvement of VFIVE, a sequence of visualization operations 
applied by the user is automatically stored. The user can make VFIVE "remember" the best visualizations from the 
history through the mobile device. 

VII. COMPLEXCOPE AT NIFS 
A. Hardware 

CompleXcope (Fig. [T3|) is a CAVE system installed at National Institute for Fusion Science (NIFS). The configu- 
ration is a cube with three walls and floor. The side length is 3m. 




FIG. 13: Overview of CompleXcope at National Institute for Fusion Science. A cubic CAVE with 3m sides. This CAVE system 
is used for nuclear fusion science and plasma physics. 

An optical system (ARTtrack) is used for the head and hand tracking. Five cameras are installed on the ceiling. 
Three-dimensional sound system is also installed. Four DLT projectors (Christie Mirage S-I-3K) are used. The image 
resolution is 1050 x 1050 for each screen. 

Two sets of computer systems are connected. One is Linux-based system (SGI Asterism) with 32 GB memory and 
Quadro FX 5800 GPU. Another is Windows-based PC cluster system. Two PCs (HP Z820) are connected. Each PC 
has 64 GB memory and two sets of NVIDIA Quadro 5000. For the basic APIs, CAVElib (ver. 3.2.1) and Trackd are 
used. 

Several application programs, including VFIVE, are used in CompleXcope. Among them, an application program 
was developed to visualize a high temperature plasma equilibrium state in LHD (Large Helical Device) of National 
Institute for Fusion Scienceflij]. 

B. Applications of VFIVE 

Magnetic reconnection[l5j is one of the most important processes in plasma physics observed in laboratory exper- 
iments, magnetospheric substorms, solar flares, and so on. The magnetic energy is converted into plasma particle 
kinetic energy through the magnetic reconnection. When two magnetic field lines with an angle, a reconnection takes 
place at so-called X-point. The plasma particles, which are composed of ions and electrons, exhibit highly complex 
motions around the X-point. It is important to examine these particle trajectories. 

A new function has been added on the VFIVE at CompleXcope. The purpose is to grasp the three-dimensional 
complex orbits of the particles. Particle motions under electromagnetic fields are calculated in real timepjl. This 
is a kind of test particle simulation incorporated into VR visualization. First, VFIVE reads a snapshot data of 
electromagnetic fields obtained by a plasma simulation. As in other VFIVE applications, user can analyze the 
electromagnetic fields through various kinds of visualization methods implemented in the standard VFIVE. After 
selecting a newly added menu panel of VFIVE, the user specifies an initial position of a test particle, an ion or 
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FIG. 14: Visualization of plasma particle simulation data with VFIVE. 



electron, with the wand. This particle is released with an initial velocity vector, which is a function of position 
calculated from the simulation data. The equation of motion of the particle is integrated in real time by a numerical 
integrator with the electromagnetic forces of the loaded data. One can observe the test particle motion in 3D in the 
CompleXcope's VR space. Refer[l6] for details of the implementation and scientific results with this new visualization 
method. 

In the above visualization, plasma particle motions are analyzed under fixed electromagnetic fields, assuming no 
temporal variations. Recently, Ohno and Ohtani 17] have improved this method for dynamic analysis with temporal 
variations. A set of electromagnetic fields at tens of different time steps, which were produced by a supercomputer 
simulation, was transferred to the local HDD of CompleXcope. VFIVE reads the sequence of fields one after another. 
The user can apply any visualization method implemented in VFIVE to a specified time step data. Selected visual- 
ization method, for example the particle tracer, is applied not only to the start time step, but also every step after 
that. This makes an animated visualization of particle tracer under time varying fields. After the first cycle of this 
method, calculated visualization objects, such as polygons for the particle obits, are stored. The stored data can be 
replayed later, making it possible to review quickly the whole animated visualization. 



VIII. CONCLUSION 



In this paper, we have summarized both the developments and scientific achievements made possible by VFIVE in 
several CAVE systems in Japan. 

In contrast to commercially available visualization applications for CAVEs, our visualization application VFIVE 
has only a basic set of visualization methods. The compactness of the application is a natural consequence of its 
history. It was first developed in late 1990s by simulation researchers who were eager to analyze their own simulation 
data in a CAVE. Implemented visualization methods and user interface were, therefore, minimum. Since then, VFIVE 
has been improved under constant feedbacks from a broader range of users where CAVE systems are installed. The 
compactness of the program has helped the users and developers adding new functions. 

Through continued developments and improvements, VFIVE has become a practical tool for scientific visualization 
in CAVE systems and fruitful scientific results have been attained by this application. 
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